Natural images from the birthplace of the human eye

Here we introduce a database of calibrated natural images publicly available through an easy-to-use web interface. Using a Nikon D70 digital SLR camera, we acquired about 5000 six-megapixel images of Okavango Delta of Botswana, a tropical savanna habitat similar to where the human eye is thought to have evolved. Some sequences of images were captured unsystematically while following a baboon troop, while others were designed to vary a single parameter such as aperture, object distance, time of day or position on the horizon. Images are available in the raw RGB format and in grayscale. Images are also available in units relevant to the physiology of human cone photoreceptors, where pixel values represent the expected number of photoisomerizations per second for cones sensitive to long (L), medium (M) and short (S) wavelengths. This database is distributed under a Creative Commons Attribution-Noncommercial Unported license to facilitate research in computer vision, psychophysics of perception, and visual neuroscience.Comment: Submitted to PLoS ON

Example images from the Botswana dataset.

<p><b>A–D</b>) Some natural scenes from various albums, including a tree, grass and bushes environment, the horizon with a large amount of sky, and closeups of the ground; the last image is from the image set containing a ruler than can be used to infer the absolute scale of objects. <b>E–F</b>) The distributions of L (red), M (green) and S (blue) channel intensities across the image for images A) and B), respectively. The large sky coverage in B) causes a peak in the S channel at high values. The horizontal axis is log base 10 of pigment photoisomerizations per cone per second. <b>G–H</b>) Grayscale images showing log luminance corresponding to the images in C) and D), respectively.</p

Linearity of the camera in exposure time.

<p>The mean raw RGB response after dark subtraction of the three color channels (red, green, blue; shown in corresponding colors) is plotted against the exposure time in seconds. The values are extracted from images of a white test standard at (<b>A</b>), (<b>B</b>) and (<b>C</b>) and ISO 200 settings. Full plot symbols indicate raw dark subtracted values between 50 and 16100 raw units; these data points were used to fit linear slopes to each color channel and aperture separately. The fit slopes are 1.01 (R), 1.00 (G), 1.02 (B) for ; 1.00, 0.99, 1.02 for , and 1.01, 1.00, 1.02 for .</p

Camera spatial MTF.

<p>Estimated MTF is plotted as a function of spatial frequency for the red, green, and blue image planes (shown in corresponding colors). Solid lines show empirical fits to , where for all , is set to 1 and where any fit values greater than 1 were also set to 1. The fit parameters are for red channel, for green channel, and for blue channel. MTF values at cycles/pixel (empty plot symbols) systematically deviated from the rest and were excluded from the fit.</p

Dark response by color channel.

<p><b>A</b>) Dark response used for dark subtraction during image processing. For image exposure times below or equal to , the dark response for a given color channel (red, green, blue; plot colors correspond to the three color channels) was taken as the median over all the pixels of that color channel and over all dark image exposure times below ; for image exposures above , we use the median over all the pixels of the same color channel at the given dark image exposure time. <b>B</b>) The mean value of dark response across all pixels of the image that are not <i>“hot”</i> (i.e. pixels with raw values , more than of pixels in each color channel), for each color channel, as a function of dark image exposure time. For all dark images, the camera was kept in a dark room with a lens cap on, with the aperture set to minimum (), and ISO set to 400.</p

Spectral response of the camera.

<p><b>A</b>) The spectral sensitivity curves plotted here convert spectral radiance into standardized camera RGB values. <b>B</b>) The LMS cone fundamentals <a href="http://www.plosone.org/article/info:doi/10.1371/journal.pone.0020409#pone.0020409-CIE1" target="_blank">[29]</a>, <a href="http://www.plosone.org/article/info:doi/10.1371/journal.pone.0020409#pone.0020409-Sharpe1" target="_blank">[45]</a> for L (red), M (green) and S (blue) cones. Note that the fundamentals are normalized to have a maximum of 1. <b>C</b>) A linear transformation can be found that transforms R,G,B readings from the camera with sensitivities plotted in (A) into reconstructed fundamentals L'M'S' shown here, such that L'M'S' fundamentals are as close as possible (in mean-squared-error sense) to the true LMS fundamentals shown in (B).</p

Checking the camera calibration.

<p>Digital images and direct measurements of spectral radiance were obtained for the 24 color swatches of the Macbeth color checker chart. <b>A</b>) Raw standardized RGB values were obtained from the camera images as described in <a href="http://www.plosone.org/article/info:doi/10.1371/journal.pone.0020409#s3" target="_blank"><i>Materials and Methods</i></a>. RGB response was also estimated directly from the radiometric readings via the camera spectral sensitivities shown in <a href="http://www.plosone.org/article/info:doi/10.1371/journal.pone.0020409#pone-0020409-g009" target="_blank">Fig. 9A</a>. Plotted is the comparison of the corresponding RGB values; black line denotes equality. <b>B</b>) The luminance in measured directly by the radiometer compared to the luminance values obtained from the standardized camera RGB values. <b>C</b>) This plot shows the correspondence between the Stockman-Sharpe/CIE 2-degree LMS cone coordinates estimated from the camera and those obtained from the measured spectra. Plot symbols red, green and blue indicate L,M,S values respectively, and the data are for the 24 MCC squares.</p

Camera response as a function of aperture size.

<p>The raw dark subtracted response of the camera exposed to a white test standard (<b>A</b>) and a darker secondary image region (<b>B</b>), in three color channels (red, green, blue, shown in corresponding colors), as a function of the aperture (f-value), with exposure held constant to and ISO set to 1000. In the regime where the sensors are not saturated and responses are not very small (solid circles, raw dark subtracted values between 50 and 16100), the lines show a linear fit on a double logarithmic scale constrained to have a slope of (i.e. ). Leaving the slopes as free fit parameters yields slopes of (R), (G), (B) for the primary region (white standard) in panel A, and (R), (G), (B) for the secondary region in panel B. Data points in the saturated or low response regime (empty circles) were not used in the fit. The maximum absolute log base 10 deviation of the measurements from the fit lines is 0.1.</p

Cone Parameters for LMS Images.

<p>CVRL database is accessible at <a href="http://www.cvrl.org/" target="_blank">http://www.cvrl.org/</a>.</p

Pairwise correlations in natural scenes.

<p>We analyzed 23 images of the same grass scrub scene, taken from different distances (black – smallest distance, red – largest distance). For every image, we computed the pixel-to-pixel correlation function in the luminance channel, and normalized all correlation functions to be 1 at pixels. For largest distances, pixels, the correlations decay to zero. The decay is faster in images taken from afar (redder lines, the largest distance image shown as an inset in the lower left corner), than in images taken close up (darker lines, the smallest distance image shown as an inset in the upper right corner). All images contain a green ruler that facilitates the absolute scale determination; for this analysis, we exclude the lower quarter of the image so that the region containing the ruler is not included in the sampling.</p